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In 1972, P. W. Anderson suggested that 'More is Different', meaning that complex physical 
systems may exhibit behavior that cannot be understood only in terms of the laws governing their 
microscopic constituents. We strengthen this claim by proving that many macroscopic observable 
properties of a simple class of physical systems (the infinite periodic Ising lattice) cannot in general 
be derived from a microscopic description. This provides evidence that emergent behavior occurs in 
such systems, and indicates that even if a 'theory of everything' governing all microscopic interactions 
were discovered, the understanding of macroscopic order is likely to require additional insights. 

PACS numbers: 89.75.-k, 75.10.Hk 



I. INTRODUCTION 

The reduction of collective systems to their constituent 
parts is indispensable to science. The behavior of ideal 
gases can be understood in terms of a simple model of 
non-interacting point particles; the properties of chemical 
compounds predicted through their underlying atomic 
structure; and much of the recent advances in biology has 
been achieved by reducing biological behavior to proper- 
ties of the DNA molecule. 

These and other triumphs have fostered the optimistic 
belief that all scientific theories can ultimately be reduced 
to a small set of fundamental laws; that the universe is 
broken up into a series of reductive levels (e.g., ecosys- 
tems, multicellular living organisms, cells, molecules, 
atoms, elementary particles); and that any scientific the- 
ory that governs one reductive level can be mathemat- 
ically deduced from the laws that govern the reductive 
levels below it [H, 0). This encourages certain subfields 
to claim a kind of moral high ground, based on an ideal 
of science as determining the fundamental microscopic 
behavior, with the rest 'just' details. 

Of course, many disagree that the rest is just details. 
In 1972, P. W. Anderson laid out such a case in his ar- 
ticle "More is Different" 0], arguing that complex sys- 
tems may possess emergent properties difficult or impos- 
sible to deduce from a microscopic picture. Anderson 
gives several examples which he suggests illustrate this 
idea, based on broken symmetry, and goes so far as to 
claim that in the limit of infinite systems, emergent prin- 
ciples take over and govern the behavior of the system, 
which can no longer be deduced from the behavior of 
the constituent parts. Since macroscopic laws that gov- 
ern macroscopic observables often implicitly assume this 
infinite limit, they cannot logically be derived, even in 
principle, from microscopic principles. Is Anderson cor- 
rect? His examples were largely speculative. The ques- 
tion of whether some macroscopic laws may be funda- 
mental statements about nature or may be deduced from 
some 'theory of everything' remains a topic of debate 
among scientists 0, y| • 



In this article we strengthen Anderson's claims by 
proving that standard notions of reductionism cannot 
generally hold in a widely studied class of collective sys- 
tems, the infinite square Ising lattice. We show that for 
a large class of macroscopic observables, including many 
of physical interest, the value of those observables is for- 
mally undecidable, i.e., cannot generally be computed 
from the fundamental interactions in the lattice. Conse- 
quently, any macroscopic law that governs the behavior of 
such properties cannot be deduced from first principles. 
Our result therefore indicates that perhaps a 'theory of 
everything' may not explain all natural phenomena; ad- 
ditional experiments and intuition may be required at 
each reductive level. 

Our paper is inspired by previous results 0, [H, @| on 
undecidability in physical systems. We employ a simi- 
lar strategy, which is to map computational models into 
equivalent physical systems; the undecidability of the 
computational models then implies that there must exist 
undecidable properties of those physical systems. Our 
proof extends this mapping so that these undecidable 
properties encompass a large class of observables that 
are physically interesting on macroscopic scales. These 
results present analytical evidence for emergence. 



II. REDUCTIONISM AND THE PERIODIC 
ISING LATTICE 

Square Ising lattices describe a classical system of spins 
arranged at the vertices of a d-dimensional rectangular 
grid. The state of each spin is described by a single value 
(0 or 1) and interacts only with its 2c? neighbors. In 
this paper, we work with planar lattices (d = 2), though 
our results easily generalize to higher dimensions. While 
this simple model was first introduced to describe mag- 
netic materials Q, where each spin describes the orien- 
tation of a microscopic magnetic moment, it has become 
ubiquitous in modeling a diverse range of collective sys- 
tems, including lattice gases B, n eural activity [U, pro- 
tein folding 0], and flocking [10| . Emergence in such 
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models would thus suggest it is of common occurrence in 
nature. For convenience, we use the standard terminol- 
ogy of magnetism, though our arguments apply equally 
to other applications of the model. 

Mathematically, we index each spin of the 2-d square 
Ising lattice by a vector of integers x = (Fig.[lja)), 
such that s x <E {0, 1} denotes the state of the spin at 
location x. Interactions on this lattice are described by 
the Hamiltonian H, a function that maps each configu- 
ration of the lattice to a real number corresponding to 
energy. The general Ising model with an external field 
has a Hamiltonian of the form Q 

H = ^ C x , y S x S y + ^2 ^xSx (1) 

where c x . y are the interaction energies between spins s x 
and s y , and M x describes the external field at site x. We 
say spins j and k interact if c,-^ ^ 0. The ground states 
of the system are configurations that minimize the value 
of H. 




properties. While a priori, there is no guarantee that 
such laws should exist, the existence of thermal physics 
and other macroscopic principles suggests that the uni- 
verse conspires in many instances to give the macroscopic 
world some sort of order [3| . 

In contrast, reductionism contends that any macro- 
scopic order can be understood by decomposing the sys- 
tem to its basic interactions, i.e., the known interactions 
of each periodic block within the lattice. Thus, from a 
reductionist perspective, the fundamental science of such 
a system is the determination of these interactions, and 
the rest is just working out the consequences of those 
interactions. 

We construct a class of periodic Ising models that di- 
rectly contradict this perspective. In particular, we con- 
sider 2-d macroscopic lattices where the spins of a 1-d 
edge are fixed by some spatially varying external mag- 
netic field. We will show that at its lowest energy state, 
a general class of macroscopic properties cannot be gener- 
ally predicted from knowledge of the lattice Hamiltonian 
Hk . Thus any macroscopic law that governs these quan- 
tities must be logically independent of the fundamental 
interactions. 

In practice, of course, many periodic Ising systems are 
soluble. What relevance, then, do these results have for 
the practice of science? We observe that in many cases of 
physical interest (e.g., the 3-d Ising model), no explicit, 
formal solution is known; it is possible that this is not 
merely a product of our ignorance, but rather because 
no solution exists. 



III. THE APPROACH 



FIG. 1: The square Ising lattice (a) consists of a rectangular 
grid of spins such that only adjacent spins interact, i.e., c x>y = 
unless |x — y| = ^ \ x i ~ Vi\ = !• Such a lattice is periodic if 
it can be specified completely by some Hamiltonian that 
acts on a K x K Ising block (b). Note that the Hamiltonians 
are tesselated in such a way that the adjacent blocks always 
share one common row or column. 

Consider a macroscopic system modeled by a square 
Ising lattice of N x N spins, with JV 3> 1. Such systems 
often exhibit periodicity, i.e., clusters of spins are often 
found to experience similar interactions. We can specify 
such systems by periodic Ising models, which consist of 
a tessellation of spin blocks, each governed by identical 
intra- and inter-block interactions (Fig. Q] (b)). 

Understanding the behavior of such a macroscopic sys- 
tem need not entail knowledge of the dynamics of each 
individual microscopic constituent. The physically rele- 
vant observables, at macroscopic scales, such as magne- 
tization (the proportion of spin in state 1), are generally 
global properties of the lattice. Insight into the behav- 
ior of such systems may be obtained from knowledge of 
the macroscopic laws that govern the dynamics of such 



Our approach is inspired by the existence of 'emergent' 
phenomena in mathematics. Unlike physical systems, the 
axioms that define a mathematical system, its analogous 
'theory of everything', are known; yet, many properties 
of such systems cannot be proven either true or false, 
and hence are formally undecidable [ll| . The Turing ma- 
chine 12] is one such system. First proposed to formally 
describe a universal computer, Turing machines are the- 
oretical devices that consist of a finite state machine that 
operates on an unbounded one-dimensional array of bi- 
nary states. Despite the fact that the behavior of these 
machines is formally characterized, most questions re- 
garding their long-term dynamics are undecidable. 

One well known example of undecidability is the halt- 
ing problem [l2j], which asks whether a given machine 
ever halts on a specific input. In fact, a much more gen- 
eral class of questions is undecidable. Rice's theorem [13[ 
states that any non-trivial question about a Turing ma- 
chine's black-box behaviour is undecidable, i.e., any ques- 
tion about the functional relationship between inputs and 
outputs. For example, Rice's theorem tells us that there 
is no general algorithm which will tell us whether or not 
a given Turing machine acts to square its input, although 
of course for specific machines it may be possible to de- 



3 



tcrmine whether or not this is the case. 

Numerous simple physical systems capable of simu- 
lating arbitrary Turing machines have been proposed, 
e -g-> [a. IT3|. Since such 'universal' systems are as power- 
ful as Turing machines, and thus an arbitrary computer, 
the only viable general method of predicting the dynam- 
ics of such systems is by direct simulation. The only way 
to find whether or not it halts is to run the machine ad 
infinitum, there exists no algorithm that can determine 
the eventual behavior of any universal system. 

The 'Game of Life' [l5| is a well-known example. The 
state of this system consists of an infinite 2-dimensional 
rectangular grid of cells, each of which is either alive or 
dead. The system evolves in discrete time steps, where 
the fate of each cell depends on the state of the eight cells 
in its neighborhood (i.e., the 3x3 block centered around 
the cell). Although this simple system exhibits dynam- 
ics entirely defined only by a binary function (its update 
function) on nine bits, it is universal. The 'Game of Life' 
is not unique, and belongs to a general class of discrete 
dynamical systems known as cellular automata (CA), in- 
cluding Life without Death [la ] and the 1-dimensional 
Rule 110 [l|. 

The dynamics of a CA are governed by an update rule 
applied identically to each cell, reminiscent of a peri- 
odic Ising lattice where each block experiences the same 
Hamiltonian. This motivates encoding the dynamics of 
a CA in the ground state of the periodic Ising lattice. 
While such constructions exist EDI 13, our constructions 
must be tailored so computing the macroscopic proper- 
ties of the lattices would entail knowledge of the unde- 
cidable properties of the underlying CA. 



IV. THE CELLULAR AUTOMATA ENCODING 

We encode the dynamics of any d-dimensional CA 
within the ground states of a (d + l)-dimensional peri- 
odic Ising lattice with a particular Hk The construction 
is not unique; a given CA may be simulated by an infinite 
number of different periodic Ising lattices. 

Formally, we consider a CA that consists of a d- 
dimensional lattice of cells, each of which may be either 
or 1. The neighborhood of a cell is the set of cells in 
a block of cells (2r + 1) on a side, and centered on the 
cell, where r is some positive integer that specifies the 
size of the neighborhood we are considering. The way 
the state of a CA changes at each time-step is dictated 
by a local update rule, i.e., a function, /, that maps this 
neighborhood to {0, 1}. For example, the state of any 
1-dimensional CA is defined by an infinite array of bi- 
nary numbers . . . &_i,t&o,tfri,tfr2,t • ■ ■ at time t. If r = 1, 
then at t + 1, the state of each cell updates according 
to b k ,t+i = f (bk-i,u h,t, bk+ij)- In order to avoid bur- 
densome notation we will explicitly outline the mapping 
of a CA to a periodic Ising lattice for the simple case of 
d = r = 1. The general mapping follows identical ideas. 

We make use of 'designer Ising blocks', bounded 2- 



dimensional blocks of spins with an associated Hamilto- 
nian whose ground state encodes a desired logical oper- 
ation /. The input is encoded in bits on one boundary 
of the block, while output bits on the boundary opposite 
(Fig. [2]) . Formally, consider an arbitrary binary function 
/ with m inputs and n outputs; we define a 'designer 
Ising block' as follows. Take a C x D block of spins, 
where C, D > max(m, n), governed by a Hamiltonian Hf 
with ground state set Qf. We designate m input spins, 
s = (si, S2, ■ ■ ■ , s m ) from the first row to encode the in- 
put and n output spins, V = (ri, r%, . . . , r n ) from the 
last row as output. 

We say a configuration of the lattice, s, satisfies 
{ s , V} if the input and output spins are in states s 
and ~r* respectively. Suppose that (1) there exists s G Qf 
that satisfies { s , •} for each of the 2 m possible inputs of 
/ and (2) every s e 5/ satisfies { ~s, "r* = f(~s)}, then 
we can set the ground state of the Ising block to simulate 
the action of / on any desired input by appropriately bi- 
asing the input spins by external fields. In fact, previous 
results fl9j indicate appropriate blocks exist for any /; 
we outline an explicit method in the Appendix. 




FIG. 2: For any binary function /, we can construct an Ising 
block such that its ground state encodes /. If the input bits 
Si are fixed, then the output bits n = f(si) when this block 
is at ground state. 



To simulate the dynamics of a CA with an update func- 
tion /, we utilize designer Ising blocks that simulate (1) 
the update function /; (2) the three way FANOUT func- 
tion that takes a bit as input and makes two copies; (3) 
the SWAP function, which switches the states of its two 
inputs. Like the construction of a digital circuit these 
building blocks can be tesselated together to simulate 
the dynamics of any given CA (See Figure [3]). The set 
of ground states of the resulting periodic Hamiltonian 
encodes the dynamics of the given CA for all possible 
initial conditions. The application of an external field 
to the first row (layer) of the lattice then simulates the 
evolution of the encoded CA with a particular initial con- 
dition. Thus, the ground state of the periodic Ising model 
is universal. 
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(b) 




FIG. 3: (Color online) The dynamics of any given CA (a) 
with update rule / (b) can be encoded in the ground state 
of a periodic Ising lattice (c) through a periodic tessellation 
of designer Ising blocks that simulate the operations / (d), 
FANOUT (e), and SWAP (f). 



V. UNDECIDABLE MACROSCOPIC 
OBSERVABLES 

For each Turing machine, T, with input x, we can con- 
struct a periodic Ising lattice such that knowledge of its 
ground state implies complete knowledge of T(x). Thus, 
the ground state of such lattices must be undecidable. 
This result can be strengthened. Rice's theorem not only 
predicts that T{x) is non-computable, but also all black 
box properties of T. Examples include, 'is T(x) > 500? 
for all inputs' and 'does T double all its inputs'. Proper- 
ties such as these must correspond to a property of the 
Ising lattice. 

This motivates a Rice 's theorem for physical systems. 
Any property of a physical system is specified by a func- 
tion P that maps the configuration space of the system 
to the real numbers. Suppose the system is universal, 
and thus encodes an underlying Turing machine T. Pro- 
vided the observable property is dependent on the output 
of T(x), so that knowledge of P implies non-zero infor- 
mation about T(x), then P cannot be computable for all 
such systems. This result is quite general. Given an Ising 
lattice, there are infinitely many ways of encoding a Tur- 
ing machine. Provided a single one of these encodings 



affect the value of P, then 'Rice's theorem for physical 
systems' applies. 

A useful example is the 'prosperity' of a CA, the prob- 
ability that a randomly chosen cell at a random time 
step is alive. This equates to the proportion of living 
cells, averaged over all time steps from to infinity. In 
many universal CAs (Game of Life, Life without Death), 
information is encoded in the presence or absence of clus- 
ters of living cells of specific configurations, referred to as 
gliders or ladders. Different computational results lead to 
different numbers of gliders, and these gliders may cause 
unbounded growth of living cells. Thus, the prosperity 
of a CA is indeed dependent on the output of an encoded 
Turing machine, and must be undecidable. 

The prosperity of a CA is essentially a macroscopic 
observable — for a magnetic system, it is just the average 
magnetization of the system, up to an additive constant. 
Such observables are averaging properties. That is, we 
can divide the Ising lattice into a periodic tessellation 
of finitely sized blocks such that the property depends 
on the average of some non-constant function / on each 
block. Formally, let P : C — > M be a general function that 
maps each configuration of the Ising lattice into a real 
number, where C is the configuration space of the Ising 
lattice. Divide the Ising lattice into a periodic tessellation 
of finitely sized Ising blocks Bi,B%,... of size C X D, for 
some fixed C, D G N. Let CcxD denote the configuration 
space of each block. We introduce a non-trivial function 
/ : CcxD — * K, i.e., there exists Si,s 2 G CcxD such 
that |/(si) — /(sa)| > e, for some fixed e > 0. Define 
A(s) : C — > R, .4(s) = (/(s)) as the average of / over all 
Bi. 

We say that P is an averaging macroscopic property if 
knowledge of P(s) gives information about the value of 
A(s) for some choice of C and D. Explicitly, let TZa be 
the range of A and TZp be the range of P. Suppose that 
for each p £ Hp, P(s) = p implies A(s) [a, b] for some 
non-zero interval [a, b], then P is an averaging macro- 
scopic property. Total magnetization, average spin-spin 
correlation, and most standard quantities of physical in- 
terest can be shown to fall into this category. Indeed, 
we will show that given such a macroscopic property P, 
we construct a modified encoding scheme such that the 
value of the given observable is almost entirely dependent 
on the 'prosperity' of the underlying CA. 

The primary strategy is to replace the FANOUT blocks 
in our encoding scheme with 'magnifier blocks' (See Fig. 0] 
a). The 'magnifier block' is a 'designer Ising block' that 
simulates the 3-way FANOUT and additionally exhibits 
a ground state with notably different contributions to 
P depending on its input. Provided these blocks are of 
sufficient size, knowledge of P implies knowledge of the 
average input of these magnifiers, i.e., the prosperity of 
the underlying CA. 

Formally, assume P is decidable. In particular, the 
proposition 'P(s) = p at ground state s?" is decidable for 
any p. Then, there must exist an interval [a, b] such that 
the proposition 'A(s) lies outside [a, b] at ground state' 
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is also decidable. However, since the Ising lattice is uni- 
versal, a magnifier for any function exists. Therefore, we 
may construct a magnifier that ensures that A(s) G [a, b] 
iff the underlying prosperity is less than 1/2. The de- 
cidability of P then implies knowledge of the underlying 
prosperity. Hence, any such macroscopic property of the 
periodic Ising lattice is generally undecidable. We illus- 
trate this with a number of examples: 



(a) (b) 

. ccoo 




O statG 1 state ■ Degenerate 



FIG. 4: Magnifier blocks can be inserted into the CA encoding 
(a) and made large enough such that their properties domi- 
nate the properties of the lattice. The ground state of these 
spin blocks (pictured) can exhibit significantly different values 
of magnetization (b), correlations functions (c) and degener- 
acy (d), for different inputs. Here, degenerate spins denote 
spins whose state has no effect on the energy of the lattice. 



1. A magnetization magnifier has ground states of ei- 
ther all O's or all l's (Fig. |U(b)). Thus, magneti- 
zation is undecidable. 

2. The correlation length measures the scaling of 
lim r _>oo (s/.m, si.m+r) (where (•} denotes an average 
over all lattice sites) with r. Knowledge of the cor- 
relation length allows us to solve the undecidable 
question of whether the encoded CA will eventu- 
ally have no living cells [2(j. Thus the correlation 
length is undecidable. 

3. Finite range correlations, i.e., (s;. m , si. m + r ) or 
(sz.m, sz+r,m), for some r, measure periodic struc- 
tures. Since this property depends on the cor- 
relations of finitely sized blocks (magnified in 
Fig. d](c)), these correlations are undecidable. 

4. The partition function at zero temperature is de- 
termined by the degeneracy of the system. Since 
degeneracy can be magnified, (Fig. |U(d)) partition 
functions are non-computable. 



Chaitin [2l| has emphasized that such undecidability 
results automatically imply results about what is prov- 
able in such systems. In particular, our results imply that 
for any such observable, there must exist a specific Ising 
lattice for which it is not possible to prove the ground 
state value of the observable. The reason, in outline, is 
that if such a proof always existed, then it would be pos- 
sible to construct an algorithm for determining the value 
of the observable, simply by enumerating and checking 
all possible proofs. We expect that this result readily 
generalizes to lattices of finite temperatures and more 
exotic macroscopic observables using different encodings 
and non-deterministic CAs. 



VI. DISCUSSION AND CONCLUSION 

It may be objected that our results only hold in in- 
finite lattices, and hence are not relevant for real finite 
physical systems. Most scientists would agree that any 
finite system, with finite energy, exhibits behavior that is 
computable (but c.f., [12]). Yet infinite systems also play 
an essential role in developing our understanding of real 
physical systems. Even if we possessed a supercomputer 
capable of simulating complex systems, we would still not 
understand the system without referring to macroscopic 
concepts such as phase transitions and the renormaliza- 
tion group [231 ] , which apply only in the limit of infinite 
systems. Yet these same tools are essential to our under- 
standing of the behavior of real physical systems. 

In summary, Ising models play an important role 
in modeling many physical and biological phenomena. 
Our results indicate that in such systems, many general 
macroscopic ground state properties cannot be computed 
from fundamental laws governing the microscopic con- 
stituents. Despite complete characterization of the sys- 
tem, we can assign two different values to any such prop- 
erty, and there would exist no logical way to prove which 
assignment is correct. Instead, in specific instances, the 
best one can do is assert the value of some physically in- 
teresting properties as axiomatic, perhaps on the basis of 
experimental evidence or (finite) simulations; this would 
truly be an example where 'more is different'. 

Although macroscopic concepts are essential for un- 
derstanding our world, much of fundamental physics has 
been devoted to the search for a 'theory of everything', 
a set of equations that perfectly describe the behaviour 
of all fundamental particles. The view that this is the 
goal of science rests in part on the rationale that such a 
theory would allow us to derive the behavior of all macro- 
scopic concepts, at least in principle. The evidence we've 
presented suggests this view may be overly optimistic. A 
'theory of everything' is one of many components neces- 
sary for complete understanding of the universe, but is 
not necessarily the only one. The development of macro- 
scopic laws from first principles may involve more than 
just systematic logic, and could require conjectures sug- 
gested by experiments, simulations or insight. 
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APPENDIX A: 



UNIVERSALITY OF ISING 
BLOCKS 
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FIG. 5: (Color online) The interaction graphs of 'designer 
Ising blocks' that simulate each of the basic boolean opera- 
tions. These blocks can then be linked together by wires to 
simulate an arbitrary computation. 



In this section, we prove that the ground states of de- 
signer Ising blocks are universal. Any boolean function / 
can be represented by a logic circuit that consists of the 
following components: (1) wires (2) FANOUT gates and 
(3) NAND gates. Mathematically, these operations are 
defined as (1) Wire(&i) = h, (2) FANOUT (6 X ) = (61,61) 
(3) NAND(6i,6 2 ) = -.(&! a to). 



We convert this to a planar circuit, that is, one in 
which no wires intersect. This is achieved by replacing 
each intersection with a SWAP gate, SWAP(6i,6 2 ) = 
(62, bi). Such SWAP gates can be decomposed into 
a network of three XOR gates i.e., SWAP(&x,to) = 
XORi(XOR 2 (XORi (6i,6 2 ))), where XORi(6i,6 2 ) = 
(61 © 62,62) and XOR 2 (6i,6 2 ) = (61,61 ® 6 2 ). 



Observe that designer Ising blocks can be constructed 
to simulate of these components, i.e., (1) wires (2) 
FANOUT gates (3) NAND gates and (4) XOR gates (c.f., 
Fig. [5j. Therefore, any planar circuit, and hence any 
boolean function, can be implemented by a designer Ising 
block. 
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